SHOW AND TELL: A Seamlessly Integrated Tool For Searching with Image Content And Text
نویسندگان
چکیده
In this paper, an image search tool that combines keyword and image content feature querying and search is presented. The developed search tool tries to bridge the gap between commercial search engines, which are based on keyword search, and CBIR (Content Based Image Retrieval) systems developed mostly in the academic field, designed to search based on image content. The tool is implemented by building on and extending the open source text-based search engine Nutch and its powerful Lucene based crawling and indexing capabilities. Several user friendly search options are provided to allow users to query the index using not only words, but also by showing an image example, as well as image feature descriptions. Even though we evaluate the developed tool by running a set of controlled experiments on the COREL’ 5000 image database, the developed search tool is able to crawl images from the World Wide Web at a larger scale.
منابع مشابه
Searching in document images: what does the appearance of a document tell us about what it means?
The document understanding problem can be informally defined as the automatic extraction of meaning from documents. In the Intelligent Sensory Information Systems group we have experimented with analyzing the visual appearance of documents in order to extract meaning. That is, we concentrate on how documents look, rather than on what they say. We motivate this approach with several applications...
متن کاملShow&Tell: A Semi-Automated Image Annotation System
A multimedia system for semi-automated image annotation, Show&Tell combines advances in speech recognition, natural language processing, and image understanding. Show&Tell differs from map annotation systems and has tremendous implications for situations where visual data must be coreferenced with text descriptions, such as medical image annotation and consumer photo annotation. S how&Tell take...
متن کاملShow&tell: a semi-automated image annotation system - Multimedia, IEEE
A multimedia system for semi-automated image annotation, Show&Tell combines advances in speech recognition, natural language processing, and image understanding. Show&Tell differs from map annotation systems and has tremendous implications for situations where visual data must be coreferenced with text descriptions, such as medical image annotation and consumer photo annotation. S how&Tell take...
متن کاملShow, Don't Tell: Retrieving Cultural Assets via Gestures
Currently, almost all information retrieval systems utilize a textual interface for users to express their information needs. While this works perfectly well for searching text document collections, there are domains in which textualizing a query or context is much harder. One of these domains is the preservation of cultural heritage practices in the form of artifact usage, which involves the c...
متن کاملUsing Twitter to Assess Information Needs: Early Results
Information needs tell us why search terms are used, helping to disambiguate, for example, what exactly people are looking for with queries such as ‘Orange’ or ‘Java’. It is hard to understand goals and motivations, however, from the keywords entered into search engines alone. This paper discusses the pilot analysis of 180,000 tweets, containing search-related terms, to try and understand how p...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006